Arm backend: Make upstream testing more target specific #15920

Michiel-Olieslagers · 2025-11-20T15:06:21Z

This patch splits up our upstream testing such that only relevant items are installed and only required things are tested upstream. It removes any duplicate testing and makes the upstream testing structure more transparent and readable.

Change-Id: I14cf329eed03d9859aef97204a9f12185b9533a2

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

This patch splits up our upstream testing such that only relevant items are installed and only required things are tested upstream. It removes any duplicate testing and makes the upstream testing structure more transparent and readable. Change-Id: I14cf329eed03d9859aef97204a9f12185b9533a2

pytorch-bot · 2025-11-20T15:06:25Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15920

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 3 Unrelated Failures

As of commit 08d858a with merge base 9952aef ():

NEW FAILURES - The following jobs have failed:

Apple / build-demo-ios / macos-job (gh)
Build Presets / apple (pybind) / build (gh)
The process '/opt/homebrew/bin/git' failed with exit code 1
pull / unittest-arm-backend-with-no-deps (test_pytest_models_tosa) / linux-job (gh)
RuntimeError: Command docker exec -t 8ad43f6aa503f0ffc49ec88481a0fc34f4fe31f48805d95a6483bb9c614ed344 /exec failed with exit code 1
pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
RuntimeError: Command docker exec -t bbb3d8661ce86785ba61af87c50ec8b75b3a8aae5c8fc0ba63f4600763b3352a /exec failed with exit code 1
pull / unittest-arm-backend-with-no-deps (test_run_tosa) / linux-job (gh)
RuntimeError: Command docker exec -t faf3db2c6c4387728eb8cb580926f1f30bf9046e4c8a66e3e2694a2cb7d2fe5e /exec failed with exit code 1
pull / unittest-editable / macos / macos-job (gh)
export/tests/test_target_recipes.py::TestTargetRecipes::test_mv3_model
trunk / test-arm-backend-ethos-u (test_pytest_models_u55) / linux-job (gh)
RuntimeError: Command docker exec -t 91e9c4766e4dceede568d4f9f0e65ff68c7b5f51804eba05bf75223220a21e33 /exec failed with exit code 127
trunk / test-arm-backend-ethos-u (test_pytest_models_u85) / linux-job (gh)
RuntimeError: Command docker exec -t fc91e2f83712bda9483aa403c0596e24945795dc6dad6639126474622a35481c /exec failed with exit code 127
trunk / test-arm-backend-ethos-u (test_pytest_ops_u55) / linux-job (gh)
RuntimeError: Command docker exec -t 953caf701584b602210c2259c2f8a17b152e57fa3bd83d32e405bc4d02f80c27 /exec failed with exit code 127
trunk / test-arm-backend-ethos-u (test_pytest_ops_u85) / linux-job (gh)
RuntimeError: Command docker exec -t 460c4056111fa4a6cc520ec3164aec1ee44f3285669d14c1bf939f3a28c0b7a6 /exec failed with exit code 127
trunk / test-arm-backend-ethos-u (test_run_ethos-u55) / linux-job (gh)
RuntimeError: Command docker exec -t 6239f4dc571d958f9f75ad2b4bff569cc66fa051c8a27c632cb379b0466e832e /exec failed with exit code 127
trunk / test-arm-backend-ethos-u (test_run_ethos-u85) / linux-job (gh)
RuntimeError: Command docker exec -t 01c0c2308dbf670d31c2a2dab40f4fb67343c794ccc62d9c23ffc5b63b03a1cb /exec failed with exit code 127
trunk / test-arm-ootb-linux / linux-job (gh)
RuntimeError: Command docker exec -t 7319572faa174656be6da523b8b86806f5337fea4187c25095e915a75ff6466d /exec failed with exit code 255

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / linux / linux-job (gh) (trunk failure)
exir/backend/test/test_lowered_backend_module.py::TestBackendAPI::test_emit_nested_lowered_backend_module
pull / unittest-editable / linux / linux-job (gh) (trunk failure)
exir/backend/test/test_lowered_backend_module.py::TestBackendAPI::test_emit_nested_lowered_backend_module
trunk / unittest-release / linux / linux-job (gh) (trunk failure)
exir/backend/test/test_lowered_backend_module.py::TestBackendAPI::test_emit_nested_lowered_backend_module

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Michiel-Olieslagers requested a review from digantdesai as a code owner November 20, 2025 15:06

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 20, 2025

zingo changed the title ~~Make upstream testing more target specific~~ Arm backend: Make upstream testing more target specific Nov 20, 2025

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 20, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Arm backend: Make upstream testing more target specific #15920

Arm backend: Make upstream testing more target specific #15920

Uh oh!

Michiel-Olieslagers commented Nov 20, 2025 •

edited by pytorch-bot bot

Loading

Uh oh!

pytorch-bot bot commented Nov 20, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Arm backend: Make upstream testing more target specific #15920

Are you sure you want to change the base?

Arm backend: Make upstream testing more target specific #15920

Uh oh!

Conversation

Michiel-Olieslagers commented Nov 20, 2025 • edited by pytorch-bot bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Nov 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15920

❌ 13 New Failures, 3 Unrelated Failures

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Michiel-Olieslagers commented Nov 20, 2025 •

edited by pytorch-bot bot

Loading

pytorch-bot bot commented Nov 20, 2025 •

edited

Loading